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Abstract 

Aim of this paper is to address the problem of learning Boolean functions from 
training data with missing values. We present an extension of the BRAIN algo- 
rithm, called U-BRAIN (Uncertainty-managing Batch Relevance-based Artificial 
INtelligence) , conceived for learning DNF Boolean formulas from partial truth ta- 
bles, possibly with uncertain values or missing bits. 

Such an algorithm is obtained from BRAIN by introducing fuzzy sets in order 
to manage uncertainty. In the case where no missing bits are present, the algorithm 
reduces to the original BRAIN. 

Keywords: Boolean function, DNF, Learning algorithm, Missing Values. 
1 Introduction 

In many applications one must deal with data that have been collected in- 
completely. For example, in censuses and surveys, some participants may 
not respond to certain questions [18]; in e-mail spam filtering, server infor- 
mation may be unavailable for e-mails from external sources [5]; in medical 
studies, measurements on some subjects may be partially lost at certain 
stages of the treatment [9]; in DNA analysis, gene-expression microarrays 
may be incomplete due to insufficient resolution, image corruption, or sim- 
ply dust or scratches on the slide [20]; in sensing applications, a subset of 
sensors may be absent or fail to operate at certain regions [22] . 

Traditionally, data are often completed by ad hoc editing, such as case 
deletion and single imputation, where feature vectors with missing values 
are simply discarded or completed with specific values in the initial stage 
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of analysis, before the main inference. Although analysis procedures de- 
signed for complete data become applicable after these edits, shortcomings 
are clear. For case deletion, discarding information is generally inefficient, 
especially when data are scarce. Secondly, the remaining complete data may 
be statistically unrepresentative. More importantly, even if the incomplete- 
data problem is eliminated by ignoring data with missing features in the 
training phase, it is still inevitable in the test stage since test data cannot 
be ignored simply because a portion of features are missing. For single im- 
putation, the main concern is that the uncertainty of the missing features is 
ignored by imputing fixed values |21| . 

In this paper the general problem is posed as finding a Boolean func- 
tion that extends a partially defined one. This type of problem is studied, 
for example, in learning theory \15\ 119]. where it is called consistency prob- 
lem. In pattern recognition, a function separating two categories of data 
T and F is usually called a discriminant function (e.g., |12j). Apart from 
the existence of a solution for this problem — which is a trivial question, 
if the self-consistency of the data is assumed — it is desirable for such a 
solution to be presented in a canonical form (Boolean formulas in DNF or 
CNF, for example) and to be of minimum complexity [2]. It is well-known 
that such a problem, with a single positive given instance, is equivalent to 
a set covering problem [161 S] and, therefore, NP-hard [11]. Nonetheless, 
it is possible to find a solution of approximately minimum complexity by 
applying generalized greedy methods (see, for example, [TO] IB]). 

Here, as a further complication of the problem described above, we as- 
sume that training data might not be complete — as previoulsly introduced 
— and the values of some elements of a given data vector may not be avail- 
able. Usually a set of data which includes missing bits, is called a partially 
defined Boolean function with missing bits [3] . 

In order to deal with training data with incompletely observed attributes, 
we generalize the machine learning algorithm BRAIN [Batch Relevance- 
based Artificial INtelligence) [16] for binary classification rules. This al- 
gorithm was originally conceived for recognizing splice junctions in human 
DNA (see also [1311]). Splice junctions are points on a DNA sequence at 
which "superfluous" DNA is removed during the process of protein synthesis 
in higher organisms [7]. The general method used in the algorithm is re- 
lated to the STAR technique of Michalski [13] , to the candidate-elimination 
method introduced by Mitchell [14] , and to the work of Haussler |8j . Start- 
ing from the BRAIN algorithm, we extend it by using fuzzy sets [23], in 
order to infer a DNF formula that is consistent with a given set of data 
which may have missing bits. 
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The paper is structured as follows. 

In Section [2] we will formally describe the problem, recall some basics 
about BRAIN and motivate the use of fuzzy sets. 

In Section [3] we shall describe the algorithm U-BRAIN distinguishing — 
for the sake of clearness — three cases of increasing complexity. 

In Section H] we shall apply the algorithm and discuss its performances 
on a standard dataset [21]. We shall consider that missing bits in a dataset 
can appear for different reasons that can be essentially grouped in two cases. 
Some results are summarized in the tables contained in Appendix lAl 

Last, in Section [51 we will draw the conclusions. 

2 Problem description and formalization 
2.1 Learning problem 

The problem of finding a Boolean function that extends a partially defined 
one can be posed as follows: given a pair of disjoint sets 

T,FC {0,1}" 

and a Boolean map 

/:G^{0,1} 

where G = TUF, such that f[T] = {1} and f[F] = {0}, establish a Boolean 
function 

/* :{0,1}"->{0,1} 

such that 

f*[T] = {l}J*[F} = {0} 

The elements of T and F are usually called, respectively, positive and neg- 
ative instances. 

In [16] the author proposed an algorithm — called BRAIN (Batch Relevance- 
based Artificial INtelligence) — that infers a DNF Boolean formula in n 
variables of low syntactic complexity and consistent with a given set of pos- 
itive and negative instances. In other words, given a subset G C {0, 1}" and 
a function / : G -> {0, 1}, BRAIN yields a function /* : {0, l} n ->• {0, 1}, 
expressed with a DNF formula of approximately minimum complexity, such 
that /* coincide with / on G. 

Instances for which / gives the value 1 will be called positive, those for 
which / gives will be called negative. In order to better distinguish positive 
and negative instances, we shall denote by 



Uj, i = l,...,p 
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the positive instances and by 

Vj, j = l,...,q 

the negative ones. 

In order to build a formula consistent with the given data, BRAIN com- 
pares each given positive instance Uj with each negative one Vj and builds 
a family of sets — that are (crisp) subsets of the set L = {xi,Ti \ i = 
1, . . . , n} of all literals — as 

•Sij = {xk | u ik = l,Vjk = 0} U {x k | u ik = 0, v jk = 1} , 

or, that is the same, defined by their respective characteristic — or mem- 
bership — functions 



Xij(xk) 



1 if Ui k = 1 an d Vjk = 

otherwise 

1 if uik = and Vjk = 1 
otherwise 



= 1, . . . , n. 



Each Sij essentially represents a constraint that must be satisfied by the 
output formula; indeed it contains literals that are simultaneously positive 
in a positive instance and negative in a negative one. Therefore BRAIN, 
with a greedy approximation procedure, provides a formula that satisfies 
such conditions. 

2.2 Adding uncertainty 

Now we assume, in the same situation, that the given instances may contain 
"uncertain" values, i.e. for some elements of G we may not know all the 
coordinates. This may occur as a consequence of errors or combination of 
data from different sources or, also, as a consequence of the application of a 
lossy compression algorithm. 

Here we formalize such a cirumstance by representing G as a subset of 
{0, l} , where | represents the uncertain values. 

Gc{o,i,i 

Our aim, now, is to extend BRAIN in such a way that the new algorithm 
would infer a function /* : {0, l} n — > {0, 1}, expressed by a DNF formula of 
minumum complexity, that is consistent with / in the following sense: 
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• /* coincide with / on G n {0, l} n , 

• for any vector u = (u\, . . . , u n ) G Gn{0, i, l} n , there exists an element 
u' = (u[, . . . ,u' n ) G {0, l} n such that «j = for any Uj ^ ^ and 

r(uo = /(u). 

In what follows, by an instance we shall mean an element of {0, \ , l} 
and, if it is in {0, l} n it will be called certain. 

As we shall see, in our extensions of BRAIN, the sets Sij shall be fuzzy 
subsets of L. 

In writing DNF formulas, throughout the paper we shall often omit the 
conjunction symbol A and we shall denote by an overlined letter the negation 
of a variable, in order to make formulas more compact and readable; thus 
we may write, for instance, X1X3 V X2X4 instead of (x± A -1x3) V (-1x2 A X4). 

3 Algorithm 

3.1 Uncertainty reduction 

The first step of our algorithms aims at reducing as much as possible the 
number of missing bits. Indeed we may have instances in which missing bits 
can be recovered. Assume, for example, to have a positive instance with a 
single missing bit and a negative one with no missing bits that coincide on 
all of their certain values. In this case, since we assume the given instances 
to be self-consistent, the missing bit in the positive instance must give the 
only possible difference between the two instances, whence it must be the 
negation of the corresponding bit in the negative instance. 

Therefore, as a first step that is common to both the algorithms, we shall 
update the data as follows. 

Let (u, v) be a pair of instances, one positive and the other one negative, 
and assume that there exists a unique coordinate k G {1, . . . , n} such that 

• u r = v r G {0, 1} for all r ^ k, 

• one of the two k-th. components Uk,Vk is certain and the other one is 
not. 

In this case we must have u& = U^, hence we update the instance containing 
an uncertainty by substituting its k-th component with the negation of the 
£:-th component of the certain instance. 

This substitution shall be made whenever possible and the reduction 
iterated until no more substitutions of this kind are possible. 
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Example Let G = {ui, vi, V2}, with 

Ul = (l,l/2,0,0), Vl = (l,l,0,0),v 2 = (1,0,0,1/2). 

^From the comparison of ui and vi we obtain that the only Boolean value 
for u\2 that keeps the set of instances self-consistent is v\2, he. 0; so we set 
ui = (1,0,0,0). 

Once we update the set of instances by substituting ui with u' l5 we 
can apply the same argument to u± and V2 thus obtaining u 24 = 1 and 
v 2 = (1,0,0, 1). Therefore the new set of instances is G' = {u^, v^, v 2 }. 

After the description of the algorithms we will show, in Example 13. 71 the 
importance of the reduction. 



3.2 Repetition deletion 

It is possible that the set of instances contains redundant information, i.e. 
there are some instances that are repeated one or more times, either since 
the beginning or as a result of the reduction step. 

Such redundancy is removed by keeping each certain instance just once 
and deleting all the repetitions. 



3.3 Membership function 

We will consider the fuzzy subsets Sij of L defined by the characteristic 
function Xij ■ 



Xij { x k) 



Xij(Xkj 








if Uik = 1 and Vj k = 

if u ik > vjk and \ G {u ik , v jk } 

if u ik = v jk = \ 

otherwise 

if Uik = and Vj k = 1 

if u ik < v jk and \ G {u ik , v jk } 

if u ik = Vj k = \ 

otherwise 



Vfe = 1, . . . , n. 

Such a membership function is thought of in such a way that the certain 
values have a much prominent role w.r.t. the missing ones in a comparison 
between two instances. However, as we shall see later on, even uncertain 
information may gain relevance if the certain one is not sufficient. 
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3.4 One-to-one 

For the sake of clearness, we shall distinguish three situations, where we are 
given, respectively 

• a positive instance and a negative one, 

• a positive instance and several negative ones, 

• several positive and negative instances. 

First let us find a DNF formula that is consistent with a positive in- 
stance Uj and a negative one Vj. A term t made true by Uj and false by Vj 
must include at least one variable not assigned in the same way in the two 
instances. By the assumption of self-consistency of our instances, Xij is n °t 
constantly equal to 0. Now, if I is a literal such that Xij{f) = max Xy; f* = I 
is consistent with the given set of instances and of minimum complexity. 
If there is more than one literal satisfying such a condition, we choose the 
positive one with the lowest index — if any — or, otherwise, the negative 
one with the lowest index. By the membership function definition (2), the 
certain differences are necessarily privileged. 
Example Let 

ui = (1,1,0,1/2,1), vi = (1,0,0,1,0). 

Then 

xn(0 



1 for I £ {x 2 ,x 5 } 
1 /4 for / = Xi 
otherwise 



Therefore /* = x%. 

Example Let u x = (1,1/2,0) and v x = (1/2,0,0). Then 



Xn(0 



1/4 for I € {x!,x 2 } 
otherwise 



Therefore /* = x\. 

It is worth noting the x\ selection in the last example implies a decision 
on the negative instance, that is implicitly assumed to be v* = (1,0,0). 

3.5 One-to-many 

Now assume we have a positive instance Uj and q negative ones v±, . . . ,v q . 
In this case, the problem is equivalent to a set covering one and we follow the 
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BRAIN algorithm or, in a different version, the set covering approximation 
improvement presented in pQ. Recalling that, for a fuzzy subset F of a given 
set S, the fuzzy cardinality is defined as 

8(F) = (3) 
we define the relevance of a literal ^ in 5^- as 

where Xij is the membership function of Sij. Then we set 

1 q 

So, given the sets, we proceed as follows. 

1. Compute the relevances of each literal (the relevance of the opposite 
of the previously selected literals is always set to zero). 

2. Choose the literal I with the highest relevance. 

3. Erase the sets containing I and the occurrences of I inside the sets 
where they appear. 

4. Repeat steps 1-3 until there are no more sets. 

The resulting formula will be the conjunction of the chosen literals 
. . . , li k and is obviously consistent with m. On the other hand, for each 
j < q, Vj either contains a certain value which is in contradiction with one 
of such literals, or contains an uncertain value that is assumed, by the al- 
gorithm, contradicting a literal of /*. Then the Vj's are indeed negative 
instances of /*. 

Example Let ui = (1,0,0), vi = (0,1,1), v 2 = (1,0,1) and v 3 = (1,1/2,1). 
The S\j are crisp sets: 

Su = {xi,X 2 ,X 3 }, 5i2 = {^3}, 5*13 = {x 2 ,x 3 }. 

where 

m = / 1 for 1 = x i'^2,^3 

XllU 10 otherwise 
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X12(0 



1 for I = X3 
otherwise 



and 



1 for I = X3 
Xi 3 (Z) = { 1/32 for l = x 2 ■ 
otherwise 

The maximum resulting relevance is Riilic^) and Xiji^'i) > for all j; it 
follows /* = X3. 
Example Let 

ui = (1,0,1/2,1), vi = (0,1,1,1), v 2 = (1,0,1,0). 

The Sij's are, again, crisp sets: 

Sn = {x 1 ,x 2 ,x 3 }, Su = {xi,x 3 }. 



and 



Xn(l) 



1 for I 6 {x±,X2} 
1/8 forZ = x 3 
otherwise 

1 for I = X4 
1/8 for I = X3 , 
otherwise 



hence maxi?i = R\{x^). Once we choose X4, we erase S12, that is the only 
set in which the membership function of x\ is not 0. Then we choose x\ in 
Su and the resulting formula is /* = A x\. 

3.6 Many-to-Many 

Let us now consider the case of p positive instances and q negative ones: 



Ul, 



U p ,Vi, 



'<!■ 



A consistent DNF formula will be a disjunction of a set of conjunction 
(or product) terms, i.e. of a set of conjunctions of literals. Each positive 
instance shall satisfy at least one product term and none of the terms shall 
be satisfied by any of the negative instances. So, for each pair (iij, Vj), there 
exists a term that is satisfied by u,; and, like all the other terms, is not 
satisfied by v^; this implies that such a term must contain a variable that is 
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not assigned in the same way in and Vj, which means that it contains a 
literal of Sij. Then, for all i = 1, . . . ,p and j = 1, . . . , q, there exists a term 
in /* containing a literal in Sij. 

In this case we have the pq sets Sij that we collect, for our convenience, 

as 

Si = {Sn , . . • , Siq}, i = lj • • • , p, 

with the associated relevance functions Ri defined by ([5]) and the total rel- 
evance defined by 

R(i k ) = -j2R l (i k ) = - yx-fo). (6) 

p ^-^ pq ^-^ ^-^ 

F i=i FH j=l i=l 

The U-BRAIN algorithm uses the relevance as a greedy criterion to build 
DNF function terms. Starting from an empty term, it selects the most 
relevant variable and add it to the term, erasing all the satisfied constraints 
S^ and all the incompatible Si sets, until at least a set Si of constraints 
is satisfied (empty). This greedy choice aims at the same time both at 
covering the greatest number of positive instances and at selecting the less 
possible number of variables. The process is iterated until there are no more 
constraints. 

3.7 Negative Instances Updating 

Each time a term is produced, the implicit choices over the uncertain com- 
ponents of the negative instances, if any, must be explicited to avoid contra- 
diction with the terms to be generated in the following. So for each negative 
instance Vj, if a particular choice of the uncertain values can satisfy the last 
generated term m, i.e. there exists an element 

v' = K,...,<)e{o,ir 

such that 

Vij = v'i 

for any ^ \ and 

m(v') = 1 

then the uncertain element of lowest index of Vj is set to a certain value 
contradicting the truthness of the term. Once the negative instances have 
been updated, the algorithm checks the self-consistency of the new set of 
instances and, in case a consistency issue arises, it stops. 
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U-BRAIN algorithm 

1 Input: 

• n the number of variables, 

• G = {ui, U2, . . . , Up, vi, V2, . . . , v 9 } the set of training instances. 
Initialization: set /* = (f>. 

2 While there are positive instances in G 

2.0 Uncertainty reduction, repetition deletion. 

2.1 Sij sets: Build from G the Sij sets and collect them in Si = 
{Sij} Q j=i for alii = 1, . . . ,p. 

2.2 Start a new term: Set m = eft. 

2.3 Build the term: While there are Sij sets 

2.3.1 Relevances: Compute the relevance R(Jk), for Ik £ {xk>Xk}, 
k = 1, . . . , n; 

2.3.2 Add variable: Select such that R(lk) is equal to m&xR, 
m <- ra A Ij.; 

2.3.3 Update sets: Erase the Z/% occurrences, if any, in the Si sets 
where also Ik appears, erase the Si sets in which 1% does not 
occur, erase the Sij sets where Ik appears^ 

2.4 Add the term: f* <- f* V m. 

2.5 Update positive instances: Erase from G all the positive instances 
satisfying m. 

2.6 Update negative instances: Update uncertain values Vvj € G. 

3 Output: /*. 



Fig. 1: U-BRAIN algorithm. 
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The whole U-BRAIN algorithm can be formally depicted as in figure 1. 

It is worth noticing that, if the given set of instances is contained in 
{0, l} n , then the algorithm proposed coincides with the original BRAIN. 

As we anticipated in subsection 13.11 the following example shows the 
importance of the reduction step. 

Example Let ui = (1, 0, 0), U2 = (1/2, 1, 0) be positive instances and vi = 
(1, 1/2, 0) a negative instance. 

If we apply the reduction, first Vi shall be substituted by v[ = (1, 1,0) 
and, then, 112 will be substituted by u' 2 = (0, 1,0). Then the algorithm will 
give us the formula x\ VX2 that is consistent with the given set of instances. 

If we do not apply the reduction, both the algorithms will give back the 
formula X2 V %2 which is a tautology and, therefore, is not consistent with 
our negative instance. 

4 Performance evaluations 

We shall distinguish two cases, that essentially depend on the reason of un- 
certainty. More precisely, we may have uncertain values due to the following 
circumstances: 

1. random uncertainties, due e.g. to the presence of some noise or errors 
in data storage, transmission and/or retrieving, 

2. trustworthy uncertainties, occurring, for instance, when missing bits 
have not been provided because some of the sources recognize them as 
not relevant. 

These two aspects of incomplete information appear to naturally corre- 
spond to fuzzy logic and probability respectively [6]. 

Now, since our aim is to treat both these situations, the best approach 
seems to require both fuzzy logic and probability in some sense. So, in the 
definition of the Xij sets, we privileged the logical viewpoint assuming that 
the missing bit is a vague information that must be used only when no better 
one is present. On the other hand, the possibility that missing bits come 
from randomly distributed errors is taken care of at a subsequent stage, 
namely when we define the relevance of a literal (subsections 13.51 and 13. 6p . 
In fact the total relevance defined by ([6]) is indeed a probability distribution 
and its definition by means of the fuzzy cardinality Q gives some weight 
back to missing bits when necessary. 
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So the algorithms have been tested using the standard "Zoo" dataset in 
|24j . with the introduction of random and trustworthy missing bits alterna- 
tively. 

The dataset contains one hundred one animals divided in seven types 
(mammal, bird, reptile, fish, amphibian, insect, invertebrate) and described 
by means of fifteen Boolean attributes (hair, feathers, eggs, milk, airborne, 
aquatic, predator, toothed, backbone, breathes, venomous, fins, tail, domes- 
tic, catsize) and a numeric one (legs = 0,2,4,5,6, or 8) that we made into 
five further Boolean values (legs = 2, legs = 4, legs = 5, legs = 6, legs = 8), 
with legs = represented by assigning the value to all of them. 

The tests have been performed by considering the animals of a given 
type as positive instances and all the others as negative ones, and then 
computing /* by means of U-BRAIN. Eventually, missing bits have been 
randomly distributed inside the data, up to 50% of the total number of bits; 
analogously, the trustworthy uncertainties have been distributed among the 
data, up to 50% of the total number of bits. 

We use two indicators of the performances. The Average Error Number 
AEN is the average number of instances in the dataset erroneously classified. 
The error rate R is the ratio between the error number and the dataset size. 

In Table CD such indicators are reported while, in Appendix (Tables EHH]) 
we present some results of such performances; each "E" column indicates 
the number of errors introduced by the algorithm. More precisely, it shows 
the number of instances that the resulting formula changes from positive to 
negative or viceversa. 

In the case of random missing bits, the average error percentage is below 
1/10 of the percentage of missing bits, showing a highly reliable behaviour. 
To what extent the case of trustworthy uncertainties, as Table Q] shows, the 
results obtained by U-BRAIN show the number of errors decreases as the 
number of missing bits increases. This circumstance suggests the possibility 
of applying U-BRAIN for the reconstruction of highly compressed data, 
which is a motivation for future works. 

5 Concluding remarks 

The problem addressed in this paper is to find, given a partially defined 
Boolean function with missing bits, a Boolean formula in disjuctive normal 
form, of approximately minimum complexity, that is consistent with the 
given data. 

The solutions proposed is a learning algorithm — obtained as extension 
of the BRAIN algorithm by means of the introduction of fuzzy sets — infer- 
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Tab. 1: Overall Average Error Number and Error rate (Zoo Dataset) varying 
the missing bit percentage in the Random and Trustworthy cases. 



Random 


AEN 


R 


10% 


0.36 


0.003 


20% 


0.93 


0.009 


30% 


1.00 


0.010 


40% 


1.50 


0.015 


50% 


5.43 


0.054 




Trustworthy 


AEN 


R 


10% 


0.57 


0.006 


20% 


0.28 


0.003 


30% 


0.28 


0.003 


40% 








50% 









ring Boolean formulas from incomplete instances. The conjunctive terms of 
the formula are computed in an iterative way by identifying, from the given 
data, a family of sets of conditions that must be satisfied by all the positive 
instances and violated by all the negative ones; such conditions allow the 
computation of a relevance coefficient for each attribute (literal). 

The proposed approach introduces the possibility of managing uncer- 
tain values by considering the aforementioned sets of conditions as fuzzy 
sets, whose characteristic functions play a significant role in the relevance 
coefficients. 

The new algorithms appear to have low error rates and maintain the 
polynomial computational complexity of the original BRAIN algorithm. 
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A Test tables 



Tab. 2: Type 1 - Mammal: / = 24 



Random (1) 




/* 


E 


10% 


24 





20% 


24 





30% 


24 





40% 


24 





50% 


X3X11 V 2i 6 Xl9 


1 


Random (2) 




/* 


E 


10% 


24 





20% 


24 





30% 


24 





40% 


24 





50% 


2i2 8 V2 3 2 8 


1 


Trustworthy 




/* 


E 


10% 


24 





20% 


24 





30% 


24 





40% 


24 





50% 


24 
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Tab. 3: Type 2 - Bird: / = x 2 



Random (1) 




/* 


E 


10% 


X2 





20% 


X2 





30% 


%2 





40% 


x 17 x 8 





50% 


X17X4 





Random (2) 




r 


E 


10% 


X2 





20% 


X2 





30% 


X2 





40% 


X\iX\ 





50% 


X2 





Trustworthy 




f* 


E 


10% 


X2 





20% 


X2 





30% 


X2 





40% 


X2 





50% 


X2 
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Tab. 4: Type 3 - Reptile: / = xqx±xs V xhx 3 xq V xiqx 8 xq 



Random (1) 




/* 


E 


10% 


XiX 8 Xi2Xi 8 X 6 






Vxnx 8 a;i 8 V xiqx 8 x~i 


2 


20% 


xnx 8 xiQ V xiqXix 20 


4 


30% 


XiX 8 Xi2 V X20X$X 7 


7 


40% 


xix 8 x n V xi 6 x 3 x 6 


3 


50% 


X4X 8 X 7 V X$X20 


20 


Random (2) 




f* 


E 


10% 


XliXi 8 X 2 V Xi 6 XiX 6 


2 


20% 


XiXsXuXj V Xi 6 X 8 Xg 


4 


30% 


XiXqX 9 X2 V XnXi 8 Xi2 


1 


40% 


XiXiQ V X4X8X17 


8 


50% 


V x n x 3 


14 


Trustworthy 




r 


E 


10% 


X 15 Xg V Xi 6 X 8 X 6 


4 


20% 


Xi^ 6 X 8 V XiXi 5 Xi 6 






Vx u x 3 xq 


1 


30% 


XiX 6 X 8 V XiXi 5 Xi 6 






VX11X3X6 


1 


40% 








Vxi 6 x 8 x 6 





50% 


XlX 6 X 8 V XuX 3 X 6 






\fX 16 X 8 XQ 
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Ta b. 5: Type 4 - Fish: / = 2:12X3 



Random (1) 




/* 


E 


10% 


Xi XgX 3 





20% 


X12X3 





30% 


X10X18 


1 


40% 


X10X18 


1 


50% 


X10X9 


1 


Random (2) 




/* 


E 


10% 


X12X3 





20% 


^10^12 





30% 


X12X4 





40% 


X12X4 





50% 


X12X20 V X12X5 


5 


Trustworthy 




/* 


E 


10% 


^12^3 





20% 


^122:3 





30% 


2:122:3 





40% 


2:122:3 





50% 


2:122:3 
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Tab. 6: Type 5 - Amphibian: / = xiqXqXsx^ 



Random (1) 




r 


E 


10% 


X W XqX 8 


1 


20% 







30% 


x G x w x g 


2 


40% 


X G X W X 8 


1 


50% 


X 1S Xg 


7 


Random (2) 




r 


E 


10% 


X 16 X 6 X 2 


1 


20% 


xisxgxs V XQX W xio 


2 


30% 


XlQXlXg 


1 


40% 


xmxsxs 


1 


50% 


XgXxXis V Xi 6 XlX 8 


19 


Trustworthy 




r 


E 


10% 


X 6 X 16 X$X3 





20% 


XiqXqX$X3 





30% 


Xi6XqX$X 3 





40% 


X 6 Xi e XgX3 





50% 


Xi 6 X 6 XgX 3 
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Tab. 7: Type 6 - Insect: / = X14X10 



Random (1) 




/* 


E 


10% 







20% 


£14X7 


1 


30% 


£14X10 





40% 


x 8 x 2 x 7 V X5X2X9 


2 


50% 


X9X10X14 





Random (2) 




/* 


E 


10% 


X14X6 





20% 


X9X14X10 





30% 


X14X10 





40% 


X9X7 


4 


50% 


X14X7 


1 


Trustworthy 




/* 


E 


10% 


X14X10 





20% 


X14X10 





30% 


X14X10 





40% 


X14X10 





50% 


X14X10 
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Tab. 8: Type 7 - Invertebrate: / = X9X14 V xiqXu 



Random (1) 




/* 


E 


10% 


XgXio V X9X14 





20% 


X9X14 V rcuXio 





30% 


xqXq V X9X1X7 V £9X1X5 


2 


40% 


X9X10 V X9X14 





50% 


X9X7 


3 


Random (2) 




/* 


E 


10% 


X9X14 V X9X6 





20% 


X9X5 


2 


30% 


X9X14 V X14X10 





40% 


X9X14 V X14X7 


1 


50% 


x 9 xi 


4 


Trustworthy 




/* 


E 


10% 


X9X14 V X10X14 





20% 


X9X14 V X14X6 


1 


30% 


X9X14 V X14X10 





40% 


X9X14 V X14X10 





50% 


X9X14 V X14X10 






